|
|
Computerized adaptive testing and its use in psychodiagnostic
Dlouhá, Jana ; Bahbouh, Radvan (advisor) ; Niederlová, Markéta (referee)
5 Abstract The theoretical part of the paper focuses on computerized adaptive testing (CAT) and item response theory (IRT). Also included is a chapter comparing IRT with the commonly used classical test theory (CTT). There is also a brief mention of computerized and online testing, as these types of administration differ in many aspects from conventional paper & pencil tests. The goal of this paper was to evaluate the individual ways of eEPI test administration and to compare them with eEPQ tests and self-evaluation. In the practical part the items of the extraversion scale of the Eysenck Personality Inventory (eEPI) were calibrated using a group of 124 respondents. The acquired data were subsequently used to carry out a simulation of computerized adaptive testing, which clearly demonstrated the benefits of this type of testing in comparison to the classical test form. These results were compared with the results of real CAT test administration using the original sample and a new group of respondents (Np=69, Nn=68). The results were highly correlated with the results of the simulated test. Moreover, to verify the validity of the computerized adaptive version of eEOD, the respondents' results in this test were compared with the results in the eEPQ test and in a short self-assessment scale. Finally,...
|
|
| |
|
|
Verification of rhythmic abilities of university students in the field of education and physical education and sport
Kašparová, Alena ; Novotná, Viléma (advisor) ; Pelclová, Jana (referee) ; Kyselovičová, Oľga (referee)
The thesis is focused on creating a test battery for the sense of rhythm assessment for university students in the field of Physical Education and sport. Music-sports practice lacks such tests and so far it is forced to use only tests designed for the music field. The structure of the new tests corresponds to the characteristics of the sense of rhythm from the point of view of music psychology. The tests are divided into three sections, which are Perceptual Skills and Activities (items 1 to 18), Reproductive Skills and Activities (items 19 to 27) and Production Skills and Activities (item 28). The Classical test theory (factor analysis) and Item response theory (two-parametric model) were used for the statistical processing of results. The methods also included the calculation of the reliability and validity of the test. The expected refusal of the proposed hypothesis was confirmed in both the classical test theory and item response theory. The exception was model 4, whose fit indexes, especially TLI = 0.537, showed a lack of evidence for the refusal of the hypothesis rather than for a perfect fit of the model with the data. The aim of the research was to compile and test models whose conformity with the data would be the best. The most favorable conformity was for model No. 1 and No. 5. Model 1...
|
|
|
Computerized Adaptive Testing In Kinanthropology: Monte Carlo Simulations Using The Physical Self Description Questionnaire
Komarc, Martin ; Štochl, Jan (advisor) ; Martinková, Patrícia (referee) ; Scheier, Lawrence (referee)
This thesis aims to introduce the use of computerized adaptive testing (CAT) - a novel and ever increasingly used method of a test administration - applied to the field of Kinanthropology. By adapting a test to an individual respondent's latent trait level, computerized adaptive testing offers numerous theoretical and methodological improvements that can significantly advance testing procedures. In the first part of the thesis, the theoretical and conceptual basis of CAT, as well as a brief overview of its historical origins and basic general principles are presented. The discussion necessarily includes the description of Item Response Theory (IRT) to some extent, since IRT is almost exclusively used as the mathematical model in today's CAT applications. Practical application of CAT is then evaluated using Monte-Carlo simulations involving adaptive administration of the Physical Self-Description Questionnaire (PSDQ) (Marsh, Richards, Johnson, Roche, & Tremayne, 1994) - an instrument widely used to assess physical self-concept in the field of sport and exercise psychology. The Monte Carlo simulation of the PSDQ adaptive administration utilized a real item pool (N = 70) calibrated with a Graded Response Model (GRM, see Samejima, 1969, 1997). The responses to test items were generated based on item...
|
|
|
Verification of rhythmic abilities of university students in the field of education and physical education and sport
Kašparová, Alena ; Novotná, Viléma (advisor) ; Pelclová, Jana (referee) ; Kyselovičová, Oľga (referee)
The thesis is focused on creating a test battery for the sense of rhythm assessment for university students in the field of Physical Education and sport. Music-sports practice lacks such tests and so far it is forced to use only tests designed for the music field. The structure of the new tests corresponds to the characteristics of the sense of rhythm from the point of view of music psychology. The tests are divided into three sections, which are Perceptual Skills and Activities (items 1 to 18), Reproductive Skills and Activities (items 19 to 27) and Production Skills and Activities (item 28). The Classical test theory (factor analysis) and Item response theory (two-parametric model) were used for the statistical processing of results. The methods also included the calculation of the reliability and validity of the test. The expected refusal of the proposed hypothesis was confirmed in both the classical test theory and item response theory. The exception was model 4, whose fit indexes, especially TLI = 0.537, showed a lack of evidence for the refusal of the hypothesis rather than for a perfect fit of the model with the data. The aim of the research was to compile and test models whose conformity with the data would be the best. The most favorable conformity was for model No. 1 and No. 5. Model 1...
|
|
|
Computerized adaptive testing in knowledge assessment
Tělupil, Dominik ; Martinková, Patrícia (advisor) ; Omelka, Marek (referee)
In this thesis, we describe and analyze computerized adaptive tests (CAT), the class of psychometrics tests in which items are selected based on the actual estimate of respondent's ability. We focus on the tests based on di- chotomic IRT (item response theory) models. We present critera for item selection, methods for ability estimation and termination criteria, as well as methods for exposure rate control and content balancing. In the analytical part, the effect of CAT settings on the average length of the test and on absoulute bias of ability estimates is investigated using linear regression mo- dels. We provide post hoc analysis of real data coming from real admission test with unknown true values of abilities, as well as simulation study based on the simulated answers of respondents with known true values of ability. In the last chapter of the thesis we investigate the possibilities of analysing adaptive tests in R software and of creating a real CAT. 1
|
|
|
Health and Its Socioeconomic Indicators - Reliability and Validity Testing of Scales
Juráčková, Veronika ; Remr, Jiří (advisor) ; Hendl, Jan (referee)
The diploma thesis "Health and Socio-economic Indicators - reliability and validity testing of the PSAS" deals with a theoretical concept of health and its socio-economic indicators. A substantial part of the work concentrates on the application of PSAS tools to the Czech population and determining whether the range is reliable and valid for Czech respondents. To determine the reliability, a complex test is used for the whole range through the value of Cronbach's Alpha, and then the Item Response Theory (IRT) is also tested. The IRT test is done using the 18-point Likert's range of responses, of which is the PSAS composed. The validity is tested based on confirmatory factor analysis, using the construct validity as well as analysis of cognitive interviews for face validity. The secondary data analysis is done in SPSS, MPLUS, R, and IRTPRO programs. The last two programs are used to test the lesser known Item Response Theory.
|
|
|
The Practical Use of Rasch Model
Havelková, Natálie ; Sobíšek, Lukáš (advisor) ; Fiřtová, Lenka (referee)
The Item Response Theory represents a group of statistical models and tests which might be used for analyzing cathegorical data. One of the tools described in this theory is called the Rasch model. The main theme of this thesis is describing and practical use of the Rasch model, which is used for analyzing categorical data, such as answers to questions in a questionnaire or ability test. The SHARE project database will be used as a main source of data and R will be applied.
|
|
|
Computerized Adaptive Testing In Kinanthropology: Monte Carlo Simulations Using The Physical Self Description Questionnaire
Komarc, Martin ; Štochl, Jan (advisor) ; Martinková, Patrícia (referee) ; Scheier, Lawrence (referee)
This thesis aims to introduce the use of computerized adaptive testing (CAT) - a novel and ever increasingly used method of a test administration - applied to the field of Kinanthropology. By adapting a test to an individual respondent's latent trait level, computerized adaptive testing offers numerous theoretical and methodological improvements that can significantly advance testing procedures. In the first part of the thesis, the theoretical and conceptual basis of CAT, as well as a brief overview of its historical origins and basic general principles are presented. The discussion necessarily includes the description of Item Response Theory (IRT) to some extent, since IRT is almost exclusively used as the mathematical model in today's CAT applications. Practical application of CAT is then evaluated using Monte-Carlo simulations involving adaptive administration of the Physical Self-Description Questionnaire (PSDQ) (Marsh, Richards, Johnson, Roche, & Tremayne, 1994) - an instrument widely used to assess physical self-concept in the field of sport and exercise psychology. The Monte Carlo simulation of the PSDQ adaptive administration utilized a real item pool (N = 70) calibrated with a Graded Response Model (GRM, see Samejima, 1969, 1997). The responses to test items were generated based on item...
|
|
| |
guest ::
